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Z.  Introduction 

The  factors  which  favor  the  integration  of  voice  and  data  onto  one 
network  include  the  expected  cost  savings  to  be  derived  from  sharing 
switching  and  transmission  facilities,  and  the  promise  of  using  network 
resources  more  efficiently  [1]  -  {3}.  Three  switching  techniques  have 
been  proposed  for  integration.  These  are  circuit  switching,  hybrid 
switching,  and  packet  switching.  In  circuit  switching,  a  fixed  capacity 
end-to-end  circuit  is  established  for  a  pair  of  voice  or  data  users  before 
they  commense  their  conversation.  Thus  no  queueing  delays  are  encountered 
at  the  nodes,  and  the  end-to-end  transmission  facilities  are  dedicated  to 
the  users  for  the  duration  of  their  conversation.  In  packet  switching,  both 
voice  and  data  conversations  are  digitized  and  segmented  into  packets  and 
routed  in  a  store- and- forward  manner  [4],  [5].  In  hybrid  switching,  each 
channel  is  partitioned  into  two  subchannels:  a  circuit-switched  subchannel, 
which  accommodates  voice  traffic;  and  a  packet- switched  subchannel,  which 
accommodates  data  traffic.  To  increase  the  channel  utilization,  a  "movable 
boundary"  feature  can  be  incorporated  which  permits  data  packets  to  use  any 
residual  circuit-switched  capacity  that  may  be  momentarily  available  due  to 
voice  traffic  variations  [3] . 

By  handling  voice  and  data  traffics  in  an  essentially  uniform  fashion, 
packet  switching  provides  the  capability  for  voice  and  data  conversations  to 
respond  automatically  and  rapidly  to  changes  in  traffix  mix.  Furthermore, 
the  success  of  such  public  packet-switched  data  networks  as  the  TELENET  [6] , 
the  TYMNET  [7] ,  the  TBANSPAC  (8] ,  and  the  DATAPAC  [9]  has  given  greater 
impetus  to  the  implementation  of  packet-switched  integrated  networks.  However, 
voice  conversations  are  very  sensitive  to  delay  %’ariations  while  packet 
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switching  systems  exhibit  variable  delay  due  to  the  possible  queueing  of 
packets  at  the  different  nodes.  Therefore,  before  voice  and  data  can  be 
successfully  integrated  onto  one  packet- switched  network  a  number  of 
issues  have  to  be  resolved.  In  this  paper  we  consider  two  such  issues; 
namely,  flow  control  and  routing. 

By  flow  control  we  mean  the  set  of  mechanisms  used  to  regulate  the 
entry  of  traffic  into  the  network.  The  main  functions  of  flow  control  in 
a  packet  network  include  the  prevention  of  throughput  degradation  and  loss 
of  efficiency  due  to  overload;  deadlock  avoidance;  fair  allocation  of 
network  resources;  and  matching  the  rate  at  which  the  network  accepts 
packets  to  the  rate  at  which  these  packets  are  generated  [10] .  Voice  and 
data  traffics  make  different  and  conflicting  demands  on  the  network:  they 
show  different  tolerances  to  delay  and  errors.  Voice  conversations  require 
continuous  and  real-time  delivery;  they  are  very  sensitive  to  delay  but  less 
sensitive  to  errors.  Data,  on  the  other  hand,  are  generally  intolerant  of 
errors  but  less  sensitive  to  delay;  they  need  to  be  reliably  delivered  to 
their  destinations.  Thus  flow  control  should  perform  two  additional 
functions  in  a  packet-switched  integrated  network:  It  should  ensure  that 
voice  packets  are  transmitted  with  essentially  constant  delay  while  trading 
the  speech  quality  in  response  to  network  conditions,  and  that  data  packets 
are  transmitted  with  maximum  reliability  (i.e.  no  error  or  lost  information) 
with  delay  as  a  secondary  issue. 

A  reasonable  flow  control  protocol  for  an  integrated  packet  network  would 
then  be  one  that  maintains  speech  continuity  under  all  network  conditions 
while  degrading  the  voice  quality,  by  reducing  the  voice  bit  rate,  when  the 


network  becomes  congested.  This  is  precisely  what  the  embedded  coding  scheme 
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[11]  does.  However,  by  our  definition  the  embedded  coding  scheme  does  not 
by  itself  constitute  a  flow  control  scheme.  The  flow  control  scheme  that 
has  been  proposed  for  use  in  conjunction  with  the  embedded  coding  scheme 
has  been  shown  to  have  the  potential  for  unstable  operation  [12] . 

In  this  paper  we  present  a  model  of  the  integrated  voice  and  data 
packet  network  (Section  II) .  The  work  reported  in  [11]  was  instrumental  to 
our  formulating  the  voice  traffic  model  presented  in  this  paper.  A  joint 
flow  control  and  routing  algorithm  is  constructed  which  uses  short  term 
average  information  on  the  network  utilization  to  effect  flow  control  and 
to  determine  the  routes  for  each  conversation  (Section  III) .  Flow  control 
is  effected  by  setting  the  voice  packet  lengths  and  the  data  input  rates  in 
a  manner  that  achieves  optimal  tradeoff  between  each  user's  satisfaction  and 
the  cost  of  network  congestion.  However,  even  though  our  flow  control 
scheme  is  not  prone  to  unstable  operation  if  the  scale  factors  are  well  chosen, 
the  joint  flow  control  and  routing  algorithm  is  not  as  dynamic  as  the  embedded 
coding  scheme  in  responding  to  network  congestion.  To  make  the  algorithm 
respond  more  dynamically  to  network  congestion,  we  develop  a  modified  embedded 
coding  scheme  that  could  be  used  in  conjunction  with  the  algorithm  (Section  IV) . 
An  important  feature  of  our  scheme  is  that,  unlike  [11] ,  the  interaction 
between  voice  and  data  traffics  is  taken  into  consideration  in  constructing  the 
algorithm.  Also  our  model  has  the  capability  to  handle  a  traffic  structure 
that  comprises  different  traffic  classes  which  have  different  levels  of  delay 
sensitivity.  Details  of  this  feature  are  given  in  [14]. 
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II.  Network  Model 

We  consider  a  network  consisting  of  N  nodes,  denoted  by  1,  2,...,  N; 
and  L  directed  links,  where  a  link  that  goes  from  node  k  to  node  t  is 
denoted  by  ( k,Z ) .  The  set  of  links  is  denoted  by  L.  We  assume  that  if  link 
(k ,t)  exists  then  link  (.£, k)  also  exists.  We  also  assume  that  both  voice  and 
data  sources  can  be  modelled  as  random  processes  with  slowly  varying  input 
traffic  statistics.  Further  details  of  the  motivation  for  modelling  data 
sources  this  way  can  be  found  in  Gallager  [15] ;  we  concentrate  on  the  discussion 
of  voice  sources. 

When  a  speaker  is  off-hook  (i.e.  in  the  conversational  mode) ,  he  alternates 
randomly  between  the  talkspurt  and  silence  modes,  when  in  talkspurt,  he 
generates  speech  which  is  packetized  by  a  voice  digitizer  and  sent  into  the 
network  at  a  fixed  rate  of  o  packets/sec.  The  quality  of  a  voice  conversation 
depends  on  the  bit  rate.  Since  we  have  fixed  the  voice  packet  rate,  speech 
quality  then  depends  on  the  length  of  the  voice  packets;  the  longer  the  packets 
the  higher  is  the  speech  quality.  We  let  the  speech  quality  (and  hence  the 
voice  packet  lengths)  vary  in  accordance  with  the  network  conditions.  For  data, 
we  let  the  permisible  input  rate  vary  in  accordance  with  network  conditions  and, 
therefore,  we  assume  that  data  packet  lengths  are  independent  of  network  control 
We  use  the  following  notations : 

(i,j)  conversation  *  a  conversation  that  enters  the  network  at  node  i  and 

is  destined  for  node  j . 

0(i)  *  the  set  of  nodes  k  for  which  (i,k)6l 
I ( i )  *  the  set  of  nodes  k  for  which  (k,i)SL 

fV.  (j)  *  the  expected  voice  traffic  or.  link  (i,k),  in  bits/sec, 
lk 

destined  for  node  j,  where  averaging  is  over  the 


duration  of  a  conversation 


*  the  expected  data  traffic  on  link  (i,k),  in 


l.  . 

ID 


4 


Fik 


'ik 


m.  . 

ID 

n.  . 

ID 

T 

n.  . 

ID 


S 

n.  . 

ID 


bits/sec,  destined  for  node  j,  where  averaging 
is  over  the  duration  of  a  data  session 
the  expected  packet  length,  in  bits,  of  (i,j) 
voice  conversations 

the  expected  input  rate,  in  bits/sec,  of  an 
(i,j)  data  session 

the  rate  at  which  voice  packets  are  emitted  by  a 
voice  digitizer  during  a  talkspurt,  in  packets/sec 
N 

fV.(  j)  ,  the  expected  aggregate  voice  traffic 

j-1 

on  link  (i,k) 


N  d 

5"!  f.  (j)  ,  the  expected  aggregate  data  traffic  on 

j-1 

link  (i,k) 
v-  d 

+  Fik  ,  the  expected  total  traffic  on  link  (i,k) 
the”"capacity  of  link  (i,k)  ,  in  bits/sec. 


the  number  of  (i,j)  data  sessions 
the  number  of  (i,j)  "off-hook"  speakers 


the  number  of  the  n^  off-hook  speakers  in  talkspurt 


the  number  of  the  n^  off-hook  speakers  in  silence 


Usually  n^  changes  so  fast  that  it  cannot  be  accurately  tracked  by  any  reason¬ 
able  algorithm  that  makes  use  of  global  information.  The  algorithm  we  shall 


construct  belongs  to  this  class  of  algorithms,  and  we  need  the  value  of  n4 

T 

in  our  network  model.  Therefore,  we  will  estimate  n, ,  given  n. ..  For  ease 

ID  ID 


-7- 


of  analysis,  we  assume  that  the  durations  of  talkspurts  are  exponentially 
distributed  with  mean  ^  \  and  that  the  durations  of  silent  periods  are 


exponentially  distributed  with  mean  6 


-1 


Then  the  speaker  activity  for 


the  off-hook  (i,j)  conversations  can  be  modelled  by  the  Markov  chain  shown 


in  figure  1.  Using  the  mean  value  of  n  as  its  estimate  we  obtain  [16] 


{a— r)  n.  .  =  Yn.  . 
6+4>  13  13 


(1) 


Figure  1.  Speaker  Activity  Model  for  Off-hook  (i,j)  Conversations 

Figure  2  shows  the  possible  path  delays  of  five  packets  generated 

during  a  talkspurt.  These  packets  are  routed  along  a  three- link  path 
{(i,k),  (k,£) ,  (£,j)},  and  they  arrive  at  the  destination  node  at  instants 
indicated  on  the  time  axis  labelled  "Arrival".  Generally  the  intervals 
between  packet  arrivals  are  not  uniform.  Thus  if  these  packets  are  delivered 
to  the  sink  as  soon  as  they  arrive  at  the  destination  node,  the  reconstructed 
speech  will  contain  many  uneven  and  annoying  gaps.  Therefore,  at  each 
destination  node  smoothing  buffers  are  installed  in  which  the  arriving  voice 
packets  are  temporarily  stored  and  finally  released  to  the  sink  at  the  same 
rate  at  which  the  packets  entered  the  network.  The  time  axis  labelled 
"Delivery"  in  figure  2  shows  when  these  packets  are  delivered  to  the  sink. 

Any  packet  that  arrives  later  than  it  is  required  for  delivery  to  the  sink  is 
discarded.  For  example,  packet  #4  is  discarded  because  d3  >  ~ A  fictitions 
packet  could  be  sent  to  the  sink  when  the  real  packet  arrives  late  (or 
alternatively  we  could  repeat  the  previous  packet) .  note  that  fixing  the 
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time  at  which  the  first  packet  is  delivered  to  the  sink  sets  an  upper 

limit  to  the  time  a  subsequent  packet  is  expected  to  arrive  at  the 

smoothing  buffers.  Thus  the  reason  for  the  extra  delay  TQ  -  dQ  imparted 

on  the  first  packet  is  to  help  minimize  the  likelihood  of  late  arrival  of 

subsequent  packets.  The  requirement  that  voice  packets  be  delivered  to  the 

sink  almost  in  real  time  demands  that  T-  -  d  cannot  be  made  very  large. 

u  o 


Figure  2.  Voice  Packet  Manipulation  at  Destination  Node 
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Two  main  objectives  in  the  above  scheme  are  to  reduce  the  path  delay 
of  each  voice  packet,  and  to  ensure  that  the  quality  of  the  conversation 
is  high.  However,  high  quality  is  associated  with  long  packets  which  in 
turn  generate  high  traffic  levels  with  the  attendant  larger  packet  delays. 
Thus  the  realization  of  these  objectives  resides  in  making  tradeoffs. 

This  then  suggests  that  we  formulate  an  optimization  problem  whose  solution 
will  yield  the  optimal  voice  packet  length  (and  hence  speech  quality)  for 
each  network  condition. 

In  order  to  minimize  the  dependence  of  the  fate  of  subsequent  packets 
on  Tq  (and  hence  d^) ,  we  attempt  to  make  all  voice  packets  experience 
identical  path  delays  on  the  same  route  through  imposing  some  cost  on  packet 
path  delays.  Specifically,  we  consider  a  cost  to  be  associated  with  the 
link  delay  of  each  voice  packet  and  each  data  packet.  Since  the  delay 
requirements  of  voice  packets  are  more  stringent  than  those  of  data  packets, 
we  grant  the  voice  packets  a  non-preemptive  priority ,-over  the  data  packets. 


Let  =  the  expected  waiting  time  of  a  voice  packet  at  link  (i,k) 

c* 

W  =  t"he  exPecte<^  waitin9  time  of  a  data  packet  at  link  (i,k! 
v  d  T 

w  =  {wik'  V 


_  , d  T 

r  ■  lrik'  Fik> 


where  (  ) 


T 


denotes  the  transpose  of  the  matrix. 


Then  W  *  f(F).  That  is,  the  expected  waiting  times  are  functions  of  the 
aggregate  voice  and  data  traffics.  For  example,  if  we  assume  that  the 
queue  at  each  link  is  an  M  J  G [ 1  queue  with  priority,  then  it  is  well  known 
[17]  that  the  expected  waiting  times  of  voice  and  data  packets  at  each  link 
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Ci  ,k)  are  given,  respectively,  by 


W 


r 


Cik 


W 


„d _ _ 

ik  (1  -  p  )  (1 


■> 

w  c“ 

r  ik 


P) 


(C. . 
IK 


V 

F.J  <c.. 

ik  ik 


F..) 

ik 


(2) 


(3) 


where  p  =  the  link  voice  utilization  factor 
v 

p  *  the  link  total  utilization  factor 
W  =  the  expected  regaining  time  to  completion  of  current  service 

-i!XvElTv>  *  Xd  EtTdJi 

where  X  =  the  rate  at  which  voice  oackets  arrive  at  the  link 
v 

X,  =  the  rate  at  which  data  oackets  arrive  at  the  link 
a 

Tv  =  the  time  to  service  one  voice  packet 
=  the  time  to  service  one  data  packet 


Because  of  the  priority  which  voice  packets  have  over  data  packets,  the 

effect  of  data  traffic  on  the  expected  waiting  time  of  a  voice  packet  is 

v 

rather  small.  Hence  we  define  a  congestion  cost  function  B^(F^)  to  be 

V 

the  cost  of  limiting  voice  traffic  on  link  (i,k)  to  F  .  We  assume  that 

V  V 

is  a  convex  increasing  and  twice  differentiable  function  of 

with  the  typical  plot  as  shown  in  figure  3.  The  reason  for  the  cutoff 

at  *or  0  <  ~  ^  <  1 ,  is  because,  from  (2!  for  example,  the  expected 

v 

waiting  time  approaches  infinity  as  F,^  approaches  <2.,. .  Thus  limiting  the 
average  voice  traffic  on  each  link  to  scm.e  fraction  r.  cf  the  link  capacity 
maintains  a  tolerable  expected  waiting  time  or.  the  link. 


i 


One  major  attraction  of  the  integrated  packet  network  is  the  anticipated 
possibility  of  exploiting  the  on-off  characteristics  of  voice  traffic  to 
transmit  more  data  when  voice  traffic  is  low.  In  particular,  when  the  voice 

V 

traffic  is  zero,  data  packets  should  use  link  ii,k)  as  in  an  all-data 

network.  Since  data  packet  delay  is  not  as  critical  as  voice  packet  delay, 

we  permit  a  higher  cutoff  point,  say  c  ,  for  aata  flow  on  each  link  (i,k) 

A  cutoff  is  necessary  to  account  for  the  finite  buffer  spaces  available  at 

each  link.  We  then  define  another  congestion  cost  function  to  be 

the  cost  of  limiting  the  total  traffic  on  link  (i,k)  to  F  .  We  assume 

that  G.,  (F.,  )  is  a  convex  increasing  and  twice  differentiable  function  of 
ik  ik 

F.,  ,  with  the  typical  plot  as  shown  in  figure  3. 
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Define  the  composite  cost  function  F^)  as  follows: 


D..  (F..  ,  =  B..(fYj  +  G..(F..  ) 

ik  ik  lk  ik  ik  ik  ik 


This  is  a  generalization  of  the  type  of  congestion  cost  function  which 
Gallager  and  Golestaani  [18]  defined  for  a  data  network. 

Each  user  usually  derives  some  satisfaction  from  transmitting  a  high 


quality  conversation;  and  the  higher  the  quality,  the  more  satisfied  he 

is.  Thus  we  associate  a  cost  with  the  quality  of  each  voice  conversation. 

We  define  a  cost  function  V. .  (Z. .)  to  be  the  cost  of  restricting  the  packet 

13  ID 

length  of  an  (i,j)  voice  conversation  to  1. ,.  We  assume  that  V. .  (Z. .)  is 

ID  ij 

a  convex  non-increasing  and  twice  differentiable  function  of  Z^,  with  a 

typical  plot  as  shown  in  figure  4.  There  are  two  reasons  for  choosing  this 

type  of  function.  The  first  reason  is  ease  of  analysis.  The  second  reason 

is  this:  We  note  that  v'.(Z.  .)  increases  monotor.ically  (from  minus  infinity 

ID  iD 

toward  zero) ,  which  implies  that  it  is  costly  to  degrade  the  quality  of  any 

voice  conversation  by  assigning  shorter  packets  to  that  conversation.  This 

represents  a  way  to  ensure  fairness  to  all  users.  We  define  a  to  be  the 

maximum  length  of  any  voice  packet.  The  value  a  accounts  for  the  fact  that 

there  is  a  limit  to  the  number  of  bits  the  digitizer  can  generate  in  1/S 

seconds.  It  also  accounts  for  the  fact  that  no  appreciable  improvement  in 

voice  quality  is  achieved  when  the  packet  length  exceeds  a  certain  value. 

If  bits  is  the  number  of  bits  the  digitizer  can  generate  in  1/S  seconds 

and  Sa2  bits/sec  is  the  threshold  rate  for  high  quality  speech,  then  a  <_ 

min[a, ,  a_] .  For  notational  simplicity  we  assume  that  all  (i,j)  voice 
J-  Z 

conversions  have  the  same  V. .  (Z. .) . 

ID  ID 


►*.■■£«*«»  W. -A*- 4» 


--■  V*.-  ■' 
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Figure  4.  Quality  Limitation  Cost  of  an 
(i,j)  Voice  Conversation 


We  assume  that  if  no  control  was  imoosed  on  it  an  (i,j)  data  source 

would  transmit  at  a  desired  average  rate  r°. .  When  control  is  imposed  the 

user  will  be  more  satisfied  the  closer  to  r.  .  the  assigned  rate  r  is. 

ID  ID 

Thus  we  associate  with  each  (i,j)  data  session  a  cost  function  E. .(r. .) , 

ID  ID 

which  is  the  cost  o*  restricting  the  average  input  rate  of  the  session  to 

r^.  We  assume  that  E^(r_)  is  a  convex  non-increasing  and  twice 

differentiable  function  of  r^  .  As  in  the  case  of  voice  conversations, 

the  rate  limitation  cost  function  E. . (r. .)  is  also  used  to  ensure  that  all 

3-D  ID 

data  sessions  are  fairly  treated.  For  notational  simplicity  we  assume  that 

all  (i,j)  data  sessions  have  the  same  E. . (r. .).  A  typical  plot  of  E. .(r.  .) 

ID  ID  ID  ID 

is  shown  in  figure  5. 


Figure  5.  Rate  Limitation  Cost  of  an  Ci,j)  Data  Session 
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Let  Bm  -  2_\  B..  F  , 

T  ik  ik 

x,k 


3m  =  Y]  G..(F ..) 
T  “  ik  ik 
i»k 


Vm  *  T'  yn.  .  V.  .  (£.  .) 
T  13  13 

1,3  J 


i_  =  m.  .  E.  .  (r.  . ) 

T  13  13  13 


where  Yn„  is,  as  stated  earlier,  our  estimate  of  n_.  Then  the  integrated 
network  flow  problem  can  be  formulated  as  the  following  nonlinear 
optimization  problem: 


Minimize  J  *  B„  +  G„  +  Vm  +  E„ 
T  T  T  “ 


s.  t. 


£ 

keo(i) 


4^ 


mei(i) 


1  £  1  >  j  £  N 


(6) 

(7) 


keo(i) 


4«’ 


(j) 


m.  .r. . 
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1  <  i, j  <  N  (8) 


j  1  <_  i,  j  ,k  <_  N:  i  *  j  (9) 

4(j) 

Constraints  (7)  and  (8)  are  the  so-called  continuity  (or  flow  conservation) 
equations.  They  state  that  the  total  average  traffic  coming  into  node  i  and 
destined  for  node  j  is  equal  to  the  total  average  traffic  going  out  of  node  i 


and  destined  for  node  j.  Constraint  (9)  states  that  all  flows  are  non-negative. 


Theorem  1  Let  u* 


★  *  v*  d* 

[£...,  r.  .  ,  f (j)  ,  f ( j)  ]  be  a  feasible  ooint  of 
13  13  ik  ik 


(7)  through  (9) .  Then  u*  minimizes  (6)  if  and  only  if  there  exist  two  sets 

of  numbers  X  =  {X. .}  and  u  =  (b .  .  1 ,  with  X  . .  =  0  and  y . .  =  0,  such  that  the 
3-3  13  33  33 

following  Kuhn-Tucker  conditions  are  satisifed  [13] ,  [14] : 


B'  (FVJ  +  G '  (F  *  )  +  X  . 
ik  ik  ik  ik  k3 


G.’  (F..) 
ik  ik 


F.  ■  U.  .) 

3.3  3.3 


q.  . (r.  .) 
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X.  . 

3-3 

if 

fV* 

IK 

(j)  > 

0 

X,  . 

3-3 

if 

fV* 

ik 

(j)  * 

0,  i 

1 

*  3 

(10) 

a  . 
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if 

fd* 

ik 

(3)  > 

0 

Ui3 

if 

fd; 

ik 

(j)  = 

0,  i 

+  j 

(ID 

X  .  . 

3-3 

if 

0  < 

★ 

< 

3-3 

Cl 

X.  . 

3.3 

if 

^  * 

x .  . 

*  0 

X.  . 

3.3 

if 

* 

X  .  . 

1 D 

“  a 

(12) 

"ij 

if 

0  < 

* 

r.  .  < 

3-3 

d 

r.  . 

3-3 

Ui3 

if 

* 

r.  . 
ID 

a  0 

U.  . 

3-3 

if 

* 

r .  . 

ID 

d 

3  r 
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(13) 

where  B.',  (FV,  )  is  the  derivative  of  B  (F..),  etc;  and  p,  ,U.  .) 
ik  ik  ik  ik  13  13 


-  t  V.  .  U.  .)  and  q  (r  ) 
c  13  13  3.3  13 


functions,  respectively. 


-  E.'.(r.  .)  are  called  the  voice  and  data  priority 
30  13 
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v  d 

We  define  a  voice  (data)  route  R. .  (K. .)  between  nodes  1  and  j  as 

13  13 

the  set  of  links  {(i,k),  (k,(t)  , . .  .f(n,  3)  ;  along  which  (i,j)  voice  (data) 

conversations  flow.  We  can  interpret  G^(F^)  as  the  marginal  cost  of 

data  traffic  on  link  (i,k)  or  the  "data  length"  of  link  (i,k).  Similarly, 

we  cam  interpret  B!^(F^)  +  )  as  the  marginal  cost  of  voice  traffic 

on  link  (i,k)  or  the  "voice  length"  of  link  (i,k).  Since  *  0, 

we  cam  solve  for  A. .  and  y. .  recursively  to  obtain 
13  1: 


*  =':ic,rf.k,! 


(14) 


U.  .  -  /,  .  G'  (F*  ) 

13  U,k)6Rd.  *'k  lk 
ID 


(15) 


Then  A  _  (u^)  can  be  interpreted  as  the  marginal  voice  (data)  cost  of 

v  d 

congestion  on  a  path  R^_.  (R^)  of  optimal  flow,  or  the  voice  (data)  length 
v  d 

of  path  R^(R_)  when  flow  is  optimal.  Equations  (10)  and  (11)  then  state 
that  all  traffic  flows  on  paths  of  minimum  marginal  cost,  i.e.  the  shortest 
paths.  In  (14)  and  (15)  A  and  are  defined  as  properties  of  the  optimal 
flow  and  are  difficult  to  find  without  solving  the  optimization  problem.  We 
redefine  A_  and  in  terms  of  measurable  quantities,  as  functions  of  an 
arbitrary  flow: 


a  .  .  »  Min 
ID  -v 


ID 


^lk<F:i.)  *  (FiU)  } 


R..  (Afk)e  r;  . 


x-k 


ID 


(16) 


ID 


Min 

Rf 
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.  G‘  (F ,.) 
(£, kTe  Rd.  dc  vk 


(17) 


Then  when  flow  is  optimal  the  X^_,  obtained  from  (14)  is  equal  to  that 
obtained  from  (16),  and  similarlv  for 

il 

The  voice  priority  functions  z.  .  («.  .)  are  the  marginal  gain  in  voice 

13  13 

quality  for  an  additional  voice  packet  length  allocation.  Equations  (12) 

then  states  that  optimality  occurs  when  the  marginal  gain  in  voice  quality 

is  as  close  as  possible  to  the  marginal  voice  cost  of  congestion,  X^ . , 

* 

subject  to  0  <  £,  <  a.  The  point  of  optimal  tradeoff  is  attained  when 

these  two  marginal  values  are  equal.  The  same  explanation  holds  for  data 
sessions.  A  desirable  flow  control  algorithm  would  then  be  one  that  attempts 
to  equalize  these  two  sets  of  marginal  values  for  each  conversation. 

From  (10)  through  (13)  we  observe  that  the  voice  and  data  distances  X  . 
and  are  the  main  network  parameters  required  to  find  the  routes,  and  to 

set  the  voice  packet  lengths  and  the  data  input  rates.  Thus  any  quasi-static 
routing  algorithm,  such  as  [15] ,  [19]  and  [20] ,  can  be  modified  to  jointly 
perform  the  functions  of  routing  and  flow  control.  There  are  several  ways 
to  construct  the  joint  flow  control  and  routing  algorithm,  but  we  will  define 
a  simple  one  in  the  space  of  path  flows. 

Let  SVn  -  S't'n.  .  ln . 

ID  3-3  ID 

■  the  total  expected  rate  of  all  the  (i,j)  voice  conversations 

at  iteration  n. 

„dn  n 

S. .  ■  m. .  r, . 

3-D  3.]  13 

*  the  total  expected  rate  of  all  the  (i,j)  data  conversations 
at  iteration  n 


\  m  Sij  >  0;  ^ 


the  set  of  voice  conversations  in  the  network 
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Ad  -  {  do)  |  S*j  >  0/  i.  j  = 


the  set  of  data  sessions  in  the  network 


P(i,j)  =  the  set  of  directed  paths,  with  no  repeated  nodes,  originating 
at  node  i  and  terminating  at  node  j 
vn 

Sp  =  the  total  expected  voice  traffic  from  the  (i,j)  voice  conversations 
routed  along  path  P6  P(i, j)  at  iteration  n 
dn 

S  =  the  total  expected  data  traffic  from  the  (i,j)  data  sessions 
P 

routed  along  path  pS  P(i,j)  at  iteration  n. 


Then  the  relationship  between  the  link  flows  and  the  path  flows  at  iteration 
n  is  given  by 


(i,j)£Av 


e 

pe  p(i,j) 


<$D(i,k)  S?n 


£ 

(i, j)6Ad 


E 


<Sp(i,k)  Spn 


(18) 


(19) 


where  the  incidence  term  6p(i,k)  is  defined  as  follows: 


<5  (i,k) 


|1  if  link  (i,k)6p 

| 0  otherwise 


.  .  * n  »  .  vn.  »  /_n  . 

L't  Aik  *  *  Gik|Fix' 

*  the  voice  length  of  link  (i,k)  at  iteration  n 


nn.  -  G!.  (Fn.  ) 
lk  ik  ik 


the  data  length  of  link  (i,k)  at  iteration  n 
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Then  for  each  (i,j)  voice  conversation  and  path  ?6  P(i,j)  we  define  the 
voice  length  of  path  p  at  iteration  n  as 


A 


n 


P 


(£ ,k)ep 


(20) 


Similarly,  for  each  (i,j)  data  conversation  and  path  p6  P(i,j)  we  define 
the  data  length  of  path  p  at  iteration  n  as 


y  , 

■p  *  iiy 

F  a,k)6p 


Then  the  shortest  voic<*  ird  data  distances 
iteration  n  are  gi„en,  respectively,  as 

\n .  m  Min  An 
13  p€P(i, j)  p 

yn.  =*  Min  Hn 
13 .  pep ( i , j )  p 


for  the  (i,j)  conversations  at 


(22) 

(23) 


We  formally  define  the  join  flow  control  and  routing  algorithm  as  follows: 


A. 


Update  at  Iteration  n 

1.  Each  node  i  broadcasts  B!,  (FV.n)  and  G!,  (f”  )  for  each  k  €  0(i)  . 

ik  ik  ik  ik 

2,  After  receiving  the  above  information  from  all  nodes,  node  i 

computes  the  voice  path  length  An  for  each  pe  P(i,j)  with  s'm  >  0, 

P  p 

and  the  data  path  length  II  for  each  p€  P(i,j)  with  >  0 

P  P 

according  to  (20)  and  (21)  respectively. 


3.  Node  i  determines  the  minimum  distances  Xn  .  and  un .  for  each  j 

ij  13 

such  that  (i,j)8  A  »  and  each  j  such  that  (i,j)€  A^  according  to 
(22)  and  (23)  respectively. 

4.  Node  i  computes  the  voice  priority  function  p^j(-^j)  for  each 

(i,  j)e  A  ,  and  the  data  priority  function  q.  .(r11.)  for  each 
v  ^13  13 


(i,j)e  Ad- 


Voice  Flow  Control 

For  each  j  such  that  (i,j)S  A  ,  node  i  does  the  following: 

1.  If  decrease  by  an  amount  proportional  to 

Xn.  -  p.  .  (£n.) ,  if  £n.  >0. 

1:  *13  13  13 

2.  If  An.  <  p. .(£n.),  increase  l".  bv  an  amount  proportional  to 

13  *13  13  13  ' 

p. .(£?.)  -  X?.  ,  if  in .  <  a. 

13  13  13  13 


3.  If  X?.  =  p.  .(£n.),  leave  £n .  unchanged. 

13  *13  13  13 


Data  Flow  Control  Similar  to  3  above. 

Voice  Traffic  Routing 

1.  For  each  p  S  P(i,j)  that  is  not  a  shortest  path  node  i  decreases 

the  traffic  by  an  amount  proportional  to  An.-  Xn.. 

13  13 

2.  Node  i  puts  the  remaining  (i,j)  traffic  cn  the  shortest  path.  If 
two  or  more  shortest  paths  exist,  node  i  arbitrarily  chooses  one 
of  them  to  perform  the  functions  of  the  shortest  path. 
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E.  Data  Traffic  Routing 
Similar  to  D. 

It  is  shown  in  [14]  that  if  the  constants  of  proportionality  are  sufficiently 
small,  the  joint  flow  control  and  routing  alogrithm  converges  to  the  optimal 

solution.  Note  that  we  compute  the  voice  path  lengths  of  those  paths  with 

vn  dn 

>0  and  the  data  path  lengths  of  those  paths  with  >0.  This  is 

because  it  is  usually  not  computationally  feasible  to  find  the  path  length  of 

every  path  from  node  i  to  node  j .  A  certain  amount  of  synchronization  of 

link  flow  broadcasts  is  necessary  in  the  joint  flow  control  and  routing 

algorithm. 
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IV.  A  Congestion  Control  Protocol 

In  this  paper  we  distinguish  between  flow  control  and  congestion  control, 
even  though  the  two  terms  are  often  used  interchangeably  in  the  literature. 

As  defined  earlier,  by  flow  control  we  mean  the  set  of  mechanisms  used  to 
regulate  the  entry  of  traffic  into  the  network.  Thus  the  setting  of  voice 
packet  lengths  and  data  input  rates  to  match  the  network  conditions  is  a  flow 
control  mechanism.  By  congestion  control  we  shall  mean  the  set  of  mechanisms 
used  to  reduce  high  network  loading  by  manipulating  the  traffic  already 
admitted  into  the  network.  Thus  by  this  definition,  the  embedded  coding 
scheme  [11]  is  a  congestion  control  mechanism. 

Despite  the  flow  control  we  practice,  network  congestion  can  still  take 
place.  This  can  be  caused  by  several  factors  including  the  fact  that  our 
algorithm  is  designed  for  networks  with  slowly  varying  input  statistics 
while  in  practice  the  integrated  network  may  have  rapidly  varying  input 
statistics.  In  order  to  contain  occasional  incidence  of  network  congestion, 
we  propose  to  practice  congestion  control  in  conjunction  with  the  proposed 
voice  flow  control.  Our  congestion  control  protocol  is  a  modification  of 
the  embedded  coding  scheme  [11] .  We  assume  that  after  the  packet  lengths 
have  been  set,  each  packet  is  then  encoded  into  different  segments  of  different 
orders  of  importance.  As  in  [11] ,  the  less  important  segments  may  be  discarded 
anywhere  in  the  network  when  congestion  sets  in.  The  more  important  segments 
reaching  the  destination  are  considered  capable  of  producing  usable  but  lower 
quality  speech.  In  this  scheme,  a  voice  sink  has  no  need  to  report  its  rate 
of  packet  acceptance  to  the  source  node,  as  is  done  in  [11],  because  the  joint 
flow  control  and  routing  algorithm  will  correct  any  rate  mismatch  at  the  next 
iteration  as  part  of  its  flow  control  function. 


Consider  a  somewhat  practical  way  to  implement  the  voice  flow  control 
and  congestion  control  protocols  of  our  scheme.  Assume  that  the  voice 
digitizer  emits  packets  of  fixed  length  a  bits  every  1/S  seconds,  after 
encoding  them  into  different  segments  of  different  orders  of  importance. 

The  source  node,  which  knows  what  the  appropriate  packet  lengths  should 
be  at  each  iteration,  then  strips  some  less  important  segments  of  the  packet 
to  generate  the  right  packet  lengths  before  sending  these  packets  along 
their  paths.  Finally,  any  node  may  discard  more  of  the  less  important 
segments  if  congestion  builds  up  in  the  network. 
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V.  Discussion 

The  work  reported  in  [211  car.  be  considered  as  a  generalization  of 

the  incremental  delay  routing  principles  of  Gallacer  [15] ,  and  in  this 

paper  we  have  extended  the  idea  in  [21]  to  integrated  networks.  However, 

we  have  concentrated  on  the  issue  of  voice  packet  delay  at  the  expense  of 

some  other  details.  For  example,  we  have  left  out  the  details  of  the 

dynamic  implementation  of  data  flow  control.  Also  even  though  it  is 

T 

difficult  to  use  the  set  of  instantaneous  values  of  n. .  on  a  global  basis 

13 

for  flow  control,  it  is  possible  for  each  source  node  i  to  use  the 

T 

instantaneous  values  of  n. .  as  a  guide  to  avoiding  congestion.  Finallv, 

i3 

it  is  possible  for  the  smoothing  buffers  to  deliver  voice  packets  to  the 
sink  at  a  rate  smaller  than  o,  especially  when  congestion  builds  up  and 
voice  packets  start  to  arrive  at  the  smoothing  buffers  slower  than  these 
oackets  are  delivered  to  the  sink.  Details  of  these  issues  can  be  found 


in  [14]  . 
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